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Abstract 

In the supermarket model there are n queues, each with a unit rate 
server. Customers arrive in a Poisson process at rate An, where < A < 1. 
Each customer chooses d > 2 queues uniformly at random, and joins a 
Q\ , shortest one. 

■ It is known that the equilibrium distribution of a typical queue length 
04 ' converges to a certain explicit limiting distribution as n — > oo. We quan- 

, tify the rate of convergence by showing that the total variation distance 

between the equilibrium distribution and the limiting distribution is es- 
| sentially of order n _1 ; and we give a corresponding result for systems 

f^*) . starting from quite general initial conditions (not in equilibrium). Fur- 

ther, we quantify the result that the systems exhibit chaotic behaviour: 
we show that the total variation distance between the joint law of a fixed 

■ set of queue lengths and the corresponding product law is essentially of 
5-H ' order at most nT 1 . 
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1 Introduction 



We consider the following well-known scenario, often referred to as the 'super- 
market model' [Til Ull Q~51 [SI HZ|- Let d be a fixed integer at least 2. Let n 
be a positive integer and suppose that there are n servers, each with a separate 
queue. Customers arrive in a Poisson process at rate An, where A £ (0, 1) is a 
constant. Upon arrival each customer chooses d servers uniformly at random 
with replacement, and joins a shortest queue amongst those chosen. If there is 
more than one chosen server with a shortest queue, then the customer goes to 
the first such queue in her list of d. Service times are independent unit mean 
exponentials, and customers are served according to the first-come first-served 
discipline. 

Recent work on the supermarket model includes [1 HH El [H HH] ■ The 
survey [T7j gives several applications and related results: an important applica- 
tion is to load balancing when computational tasks are dynamically assigned to 
servers in a large array. It is shown in [21 [3] that the system exhibits propagation 
of chaos given a suitable initial state, and in particular if it is in equilibrium. 
This means that the paths of members of any fixed finite subset of queues are 
asymptotically independent of one another, uniformly on bounded time inter- 
vals. This result implies a law of large numbers for the time evolution of the 
proportion of queues of different lengths, more precisely for the empirical mea- 
sure on path space [21 [3]. In particular for each fixed positive integer ko, as 
n tends to infinity the proportion of queues with length at least ko at time 
t converges weakly to a function v t (ko), where v t (0) = 1 for all t > and 
(vt(k) : k £ N) is the unique solution to the system of differential equations 

^1 = \( Vt (k - l) d ~ v t (kf) - (v t (k) - vt(k + 1)) (1) 

for k S N (see [20]). Here one assumes appropriate initial conditions vo — 
(v (k) : k e N) such that 1 > v (l) > v (2) > • • ■ > 0, and v e h. Further, 
again for a fixed positive integer fcoj as n tends to infinity, in the equilibrium 
distribution the proportion of queues with length at least fco converges in prob- 
ability to \( d 0_1 )/( d ~ 1 ) i and thus the probability that a given queue has length 
at least ko also converges to X^ d °^ 1 >/^ d ~ 1 ) . 

Recent results in 11 include rapid mixing and two-point concentration for 
the maximum queue length in equilibrium. 

The main contribution of the present paper is to give quantitative versions 
of the convergence results for the supermarket model mentioned above, and to 
extend them to hold uniformly over all times. We rely in part on combinatorial 
techniques developed in [TU1 E] • 

For each time t > and each j = 1, . . . ,n let x[ n \j) denote the number 
of customers in queue j, always including the customer currently being served 
if there is one. We shall keep the superscript 'n' in the notation in this section, 
but then usually drop it in later sections. We make the standard assumption 
of right-continuity of the sample paths. Let be the queue-lengths vector 
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(Xt(l), . . . ,Xf'(n)) £ Z" , where TI\ denotes the set of all n-vectors with 
components taking non-negative integer values. Note that the Zi-norm || X t ||i 
of X t is the total number of customers present at time t, and the Zoo-norm 
1 1 Xt | |oo is the maximum queue length. 

For a given positive integer n, the n-queue process (x[ n ^) is an ergodic 
continuous-time Markov chain. Thus there is a unique stationary distribution 
n*™) for the vector X^; and, whatever the distribution of the starting state, 
the distribution of the vector x[ n ^ at time t converges to n*™) as t — > oo. As 
already noted in (and easily verified), the distribution Il( n ' is exchangeable, 
that is invariant under permuting the co-ordinates. We shall usually write 
to denote the queue-lengths vector in equilibrium: we drop the subscript t when 
no explicit reference to a particular time is needed. 

The probability law of a random element X will be denoted by C(X). The 
total variation distance between two probability distributions fi\ and u 2 is de- 
fined by d TV (/ii, M2) = sup^ \ni(A) — H2(A)\ where the supremum is over all 
measurable sets A in the underlying measurable space (see also the start of 
Section[2]). Also, given a vector v = (v(k) : k = 0, 1, . . .) such that 

1 = u(0) > u(l) > u(2) > . . . > and v(k) -> as k -> 00, (2) 

let C v denote the law of a random variable V taking non- negative integer values, 

where Pr(V > k) — v(k) for each k = 0, 1, 2, In fact, throughout this paper 

we shall work only with vectors v £ l\. 

Finally, throughout we use the asymptotic notations 0(), f2(), o(), lu() in a 
standard way, to describe the behaviour of functions depending on the number 
of servers n as n tends to infinity; for instance f(n) = Q(g(n)) means that, for 
some constants c > and no, we have f(n) > cg(n) for all n > hq. 

We may now state four main results, two concerning approximating the 
distribution of a single typical queue length and two concerning collections of 
queues and chaos. These will be proved in the following sections, where we also 
present some further results. 

1.1 Single queues 

We first consider the n-queue system in equilibrium, and investigate how close 
the distribution of a typical queue length Y^ n \\) is to the limiting distribution. 

Let C\^d denote the law C v where v(k) = \( d for each k = 0, 1, 

Note that Pr(yW(l) > 1) = A = v(l). It is known (and was mentioned earlier) 
that C(Y^ (1)) tends to C\.d as n — > 00: we now quantify this convergence. 

Theorem 1.1 For each positive integer n let Y^ n > be a queue-lengths n-vector 
in equilibrium, and consider the length Y^(l) of queue 1. Then 

d TV {C{Y^\l)),C Kd ) 

is of order n^ 1 up to logarithmic factors. 
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In fact, we shall see that the above total variation distance is o(n _1 In 3 n) and is 
f2(n _1 ). Also, we shall deduce directly from Theorem ll.il together with a bound 
on the maximum queue length from [llj (given as ([3]) below), the following: 

Corollary 1.2 For each positive integer k, the difference between the kth mo- 
ment E[y(")(l) fe ] and the kth moment of jC\,d is of order n^ 1 up to logarithmic 
factors. 

Now we drop the assumption that the system is in equilibrium, and consider 
its behaviour from the beginning (that is, from time 0). We state one theorem 
here, Theorem 11.31 More general though less digestible results (Theorems 13.31 
and !3.4p are stated and proved in Section [31 and Theorem 1 1.31 will follow easily 
from Theorem 13.41 We assume in Theorem 11.31 that the initial queue lengths 
are iid and not too large; and see that the law of a typical queue length is close 
to C Vt , where Vt = (vt(k) : k G N) is the solution to the system ([1]) subject to 
the natural initial conditions. 

Given a queue-lengths vector x, that is a vector with non-negative integer 
co-ordinates, we let u(k,x) be the proportion of queues with length at least k. 

Theorem 1.3 There is a constant e > such that the following holds. Let the 
random variable X take non-negative values, and suppose that E[e x / £ ] is finite. 
For each positive integer n, let (x[ n ^) be an n-queue process where the random 
initial queue lengths Aq™'(1), . . . , X^ n \n) are iid and stochastically at most X . 
Let Vt = (vl (k) : k = 0, l, 2, . . .) be the unique solution to the system flj) 
subject to the initial conditions VQ l \k) — E[it(fc, X^)] for k = 0, 1, . . .. 
Then the law of x\ * s exchangeable for each t >0, and 

supd TV (C(X { t n \l)),£ v ^) = 0(n^). 
1.2 Collections of queues 

The above results concern the distribution of a single queue length. We now 
consider collections of queues and propagation of chaos. The term "propagation 
of chaos" comes from statistical physics [7] , and the original motivation was the 
evolution of particles in physical systems. The subject has since then received 
considerable attention culminating in the work of Sznitman |18j . 

Our results below establish chaoticity for the supermarket model. As before, 
we first discuss the equilibrium distribution. We see that for fixed r the total 
variation distance between the joint law of r queue lengths and the product law 
is at most 0(n~ l ), up to logarithmic factors. More precisely and more generally 
we have: 

Theorem 1.4 For each positive integer n, let Y^ n > be a queue-lengths n-vector 
in equilibrium. Then, uniformly over all positive integers r < n, the total vari- 
ation distance between the joint law ofY^ n \l), . . . , Y^ n \r) and the product law 
C(Y^ n \l))® r is at most 0{n~ x In 2 ri(21nlnn) r ); and the total variation distance 
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between the joint law of Y^(l), . . . , Y^ n \r) and the limiting product law C® r d 
is at most 0{n~ l In 2 n(21nlnn) r+1 ). 

Note that since the distribution of is exchangeable, for any distinct indices 
jx, . . . ,j r the joint distribution of Y^(ji), . . . , Y^ n \j r ) is the same as that of 
F( n '(l),...,y( n !(r). Also, if d were 1 we would have 'exact' independence of 
all queues in equilibrium. Further, note that the above result can yield a bound 
less than 1 only if r < Inn/ In In Inn; but as long as r — o(lnn/lnlnlnn) the 
bound is 0(n~ 1+0 W). We shall mention in Section [5] how this result relates to 
Sznitman's treatment of chaos in [THj - see in particular the inequalities (|19p 
and ((201) below. 

Now we drop the assumption that the system is in equilibrium, and consider 
its behaviour from time 0. We state one theorem here, Theorem 11.51 More 
general though less digestible results (Theorems 14.11 and 14. 2\i are stated and 
proved in Section [4] and Theorem 11.51 will follow easily from Theorem 14.21 As 
with Theorem 11.31 earlier, we assume in Theorem 11.51 that the initial queue 
lengths are iid and not too large: now we see that the joint law of r queue 
lengths is close to the product law, that is we have chaotic behaviour, uniformly 
for all times. 

Given an n-queue process (X^) and a positive integer r < n, let £j™' r ^ 
denote the joint law of xj: n \l), . . . , x[ n \r), and let c[ n ' r ^ denote the product 
law £(X ( t n) (l))® r of r independent copies of A f (n) (l). 

Theorem 1.5 Let the random variable X take non-negative values, and suppose 
that the moment generating function E[e s ° x ] is finite for some so > 0. For each 
integer n > r, let (X^) be an n-queue process where the random initial queue 
lengths Xg n \l), . . . , X^ n \n) are iid and stochastically at most X. Then the law 
of x[ n ^ is exchangeable for each t > 0, and uniformly over positive integers 
r < n 

sup dry ( 4"' r) ,4"' r) l = O ( n - 1 (\nn) r + 2 ) . 
t>o \ ' 

We remark also that an 0(n _1 ) upper bound on the total variation distance 
between the law of a finite r-tuple of queues and the product law is known on 
fixed time intervals for iid initial queue lengths - see [3], Theorem 3.5. However, 
the bound in [3] grows exponentially in time, and does not extend to the equilib- 
rium case. We are not aware of any earlier equilibrium bounds or time-uniform 
bounds like those given in Theorems 11.41 11.51 14.11 and 14.21 

Finally, let us mention at this point that connections between rapid mixing, 
concentration of measure and chaoticity have been observed earlier in various 
other contexts. The reader is referred to [51 [HI HH HH] arid references therein for 
more information. 
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2 Preliminaries 



This section contains some definitions and some results from [11] needed in our 
proofs. We start with two lemmas which show that the supermarket model 
is rapidly mixing. Lemma 12.11 upper bounds the total variation distance and 
Lemma upper bounds the Wasserstein distance between C(X t ) and the equi- 
librium distribution II. 

We say that a real-valued function / defined on a subset A of M™ is 1- 
Lipschitz if |/(x) — f(y)\ <|| x — y ||i for all x,y € A. Let us recall two 
equivalent definitions of the total variation distance d TV (fj,i, ^i 2 ) between two 
probability distributions /zi and fx 2 on Z™, and two corresponding definitions 
of the Wasserstein distance d w (m,fj, 2 ). We have d TV (fj,i , fi 2 ) = inf Pr(X ^ Y), 
and d w (/j,i, jj, 2 ) = inf E[|| X — Y where in each case the infimum is over all 
couplings of X and Y where C{X) — \i\ and C(Y) — fj, 2 . Also, 

rf T v(Mi)M2)=o SU P I / <f>dfjLi- [ <f> dfi 2 \ 

Z M\ao<l J J 

where the supremum is over measurable functions <f> with H^Hoo^ 1; and 



dwiVi, V2) = sup I / / dm - / / dfj, 2 \ 

where the supremum is over the set T\ of 1-Lipschitz functions / on Z". The 
total variation distance between the corresponding laws on Z™ is always at most 
the Wasserstein distance: to see this, note for example that Ix=£Y <\\X — Y\\i. 
Recall that < A < 1 and d € N are fixed. 

Lemma 2.1 For each constant c > there exists a constant r\ > such that 
the following holds for each positive integer n. For each time t > let 

6 n , t = Pr(|| X W ||!> cn) + Pr(\\X^ || 00 > nt). 

Then 

d TV {C{x[ n) ),U) < ne-" 4 + 2e-" n + S n>t . 

Lemma 2.2 For each constant c > there exists a constant 77 > such that 
the following holds for each positive integer n. Let denote the stationary 

maximum queue length. Consider any distribution of the initial queue-lengths 
vector Xq such that ||-Xq ||i has finite mean. For each time t > let 

S n , t = 2E[|| X ( n) \U l m ^ h> J + 2cn Pr(\\X ( n) || co > r,t). 



Then 



d„,(£(X t (n) ),II) < ne-"* + 2cnPr(M^ > nt) + 1e^ n + 5 n „ 
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We now introduce the natural coupling of n-queue processes (X t ) with dif- 
ferent initial states. Arrival times form a Poisson process at rate An, and there 
is a corresponding sequence of uniform choices of lists of d queues. Potential 
departure times form a Poisson process at rate n, and there is a correspond- 
ing sequence of uniform selections of a queue: potential departures from empty 
queues are ignored. These four processes are independent. Denote the arrival 
time process by T, the choices process by D, the potential departure time pro- 
cess by T and the selection process by D. 

Suppose that we are given a sequence of arrival times t with corresponding 
queue choices d, and a sequence of potential departure times t with correspond- 
ing selections d of a queue (where all these times are distinct). For each possible 
initial queue-lengths vector x G Z™ this yields a deterministic queue-lengths pro- 
cess (x t ) with xq — x: let us write x t — s t (x; t, d, t, d). Then for each x G Z™, 
the process (st(x; T, D, T, D)) has the distribution of a queue-lengths process 
with initial state x. The following lemma from [11] shows that the coupling 
has certain desirable properties. Part (c) is not stated explicitly in [TT], but 
it follows easily from part (b). Inequalities between vectors in the statement 
are understood to hold component by component. 'Adding a customer' means 
adding an arrival time and corresponding choice of queues. 

Lemma 2.3 Fix any J^-tuple t. d, t, d as above, and for each x G Z™ write St(x) 
for s t (x; t, d, t, d). Then 

(a) for each x, y G Z" , both \\ s t {x) - s t {y) ||i and || s t (x) - s t (y) ||oo are 

non-increasing. 

(b) if < t < t' and st(x) < s t (y) then st>(x) < st>(y); 

(c) if t' and d' are obtained from t and d by adding some extra customers 
then, for all t > 0, s t (x; t' , d', t, d) > s t (x; t, d, t, d). 

Next, let us consider the equilibrium distribution, and note some upper 
bounds on the total number of customers in the system and on the maximum 
queue length established in [TT] . 

Lemma 2.4 (a) For any constant c > jzr\, there is a constant r\ > such 

that for each positive integer n, in equilibrium the queue-lengths process (Y t ) 
satisfies 



for each time t > 0. 

(b) For each positive integer n, in equilibrium the maximum queue-length 
satisfies 





for each positive integer j and each time t > 0. 
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We shall require an upper bound on the maximum length of a queue in 
equilibrium, from Section 7 of [11]. Let i* = i*(n) be the smallest integer i such 

that A^T" < n~ 1/2 \n 2 n. Then i* = lnlnn/lnd+ 0(1); and with probability 
tending to 1 as n — > oo, if d = 2 then M (") is i* or i* + 1, and if d > 3 then 
M^ n ) is i* — 1 or i*. The bound we need is that if r = r(n) = O(lnn) then 

Pr(M (n) > i* + 1 + r) = e - n{rlnn) . (3) 

Now we state some concentration of measure results for the queue-lengths 
process (X^). Let us begin with the equilibrium case, where we use the nota- 
tion yW, Recall that T\ denotes the set of 1-Lipschitz functions on Z™ . (We 
suppress the dependence on n.) 

Lemma 2.5 There is a constant c > such that the following holds. Let n > 2 
be an integer and consider the n-queue system in equilibrium. Then for each 
f G T\ and each u > 

Pr(j/(y("))-E[/(y(™))]| >u) <ne~ cu/ni . 

Let £(k,x) denote \{j : x(j) > k}\, the number of queues of length at least 
k. Thus £(k,x) — nu(k,x). Tight concentration of measure estimates for the 
random variables £(k, Y) may be obtained directly from the last lemma. 

Lemma 2.6 Consider the stationary queue-lengths vector Y^ n ' , and for each 
non-negative integer k let £(k) = E[£(k, Y^)}. Then for any constant c > 0, 

Pr(sup|f(fc,y (n) ) -£{k)\ > cnhn 2 n) = e^ 1 " 2 ™). 

k 

Also, there exists a constant c > such that 

supPr(|£(fc, y (n) ) - ^(jfc)| > cni Inn) = o( n - 2 ). 

k 

Furthermore, for each fixed integer r > 2 

sup \E[t(k, y(")) r ] - £(k) r \ = 0{n r - 1 In 2 n). 

k 

The first and third parts of this lemma form Lemma 4.2 in |llj : the second part 
follows directly from the preceding lemma. We now present a time-dependent 
result, which will be essential in the proof of Theorem 13. 31 

Lemma 2.7 There is a constant c > such that the following holds. Let n > 2 
be an integer, let f G Fi, let xq G Z", and let Xq — xo almost surely. Then 
for all times t > and all u > 0, 

Pr(|/(X t (n) ) - E[f(X^)}\ >u)<n e"^. (4) 
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We shall also use the following extension of Bernstein's inequality, which will 
follow easily for example from Theorem 3.8 of [14]. 

Lemma 2.8 Let f be a 1-Lipschitz function on W L . Let Z = (Zi, . . . , Z n ) 
where Z\ , . . . , Z n are independent real-valued random variables, such that Zj 
has variance at most er| and range at most b, for each j = 1, . . . , n. Let v = 
Y^j=i °j- Then for each u > 

Pr(|/(Z)-E[/(Z)]| >«) <2exp 



2v + ^bu 



Proof. Given fixed numbers z\, . . . , where 1 < j < n, for each z let 

g( z ) = E[f(zi,...,Zj-i,z,Zj +l ,...,z n )]. 



Then the function g is 1-Lipschitz, so the random variable g{Zj) has variance 
at most a| and range at most b. Thus, in the terms of Theorem 3.8 of [13], the 
'sum of variances' is at most v, and the 'maximum deviation' is at most 6; and 
so we may use that theorem to deduce the result here. I 

Let u t (k) = ~E[u(k, X t )), the expected proportion of queues of length at least 
k at time t. Also let u{k) denote E[u(k, Y)], the expected proportion of queues 
with at least k customers when the process is in equilibrium. Then u(0) = 1 
and u(l) = A. Whatever the initial distribution of Xo, for each positive integer 
fc, 

- A (E[t»(fc - 1, X t ) d ] - E[«(A, X t ) d ]) - (u t (k) -ut(k+ 1)); (5) 

and for Y in equilibrium 

= A (E[tt(fc - 1, Y) d ] - E[u(fc, Y) d }) - (u(k) - u(k + 1)). (6) 

In [11], this last fact is used to show that u(k) is close to A^ d more 
precisely, for some constant c > 0, for each positive integer n 

supKAO-A^- 1 )/^- 1 )] <cn- x \^n. (7) 

k 



3 Distribution of a single queue length 
3.1 Equilibrium case 

In this subsection we prove Theorem ll.il Let us note that the equilibrium distri- 
bution II is exchangeable, and thus all queue lengths are identically distributed. 

We begin by showing that (a) in equilibrium the total variation distance be- 
tween the marginal distribution of a given queue length and the limiting distri- 
bution C\.d is small; and (b) without assuming that the system is in equilibrium, 
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a similar result holds after a logarithmic time, given a suitable initial distribu- 
tion. [In fact, the result (a) will follow easily from (b), since by Lemma [2.41 
and ([3]), if Xq is in equilibrium and we set cq > A/(l — A) then the quantity S n 
in Proposition 13. II below is o(n -1 ).] Part (a) includes the upper bound part of 
Theorem 11.11 above. 

Proposition 3.1 

(a) The equilibrium length Y^ n ' (1) of queue 1 satisfies 

d TV (£(Y (n \l)),£\.d) = C^n" 1 In 2 n lnlnn) . 

(b) For any constant Co > there is a constant c such that the following holds. 

Let S n = Pr(|| X^ n) ||i> c n) + Pr(|| X^ n) || OG > c hm). Then uniformly 
over t > chin 

max d TV (£{X ( t n \j)),£\,d) < S n + 0(n _1 ln 2 n lnlnn). 
j=l,...,n 

Let us note here that better bounds may be obtained in the simple case d = 1. 
Here the n queues behave independently, and £(Y(1)) = £\_d for each n. The 
arrival rate at each queue is always A, regardless of the state of all the other 
queues. Then it follows from the proof of Lemma 2.1 in [11] (which is stated 
as Lemma I2TT1 here) that we can drop the term Pr(|| ||i> cqu) in the mixing 
bound of that lemma, and so part (b) of Proposition 13. II holds with the bound 
S n + 0(n _1 ln 2 nlnlnn) replaced by Pr(|| X \\ 00 > c lnn) + 0{n~ K ) for any 
constant K. 

Proof of Proposition 13.11 Since the distribution of Y is exchangeable, 
Pr(F(l) > k) = u(k) for each non-negative integer k. Note that u(0) — u(l) = 
1 — A. Part (a) now follows easily from ([7]), since 

d TV (£(Y(l)),£ x , d ) = i^| u (fc)- u (fc + l)-A 1+d +-+^ 1 +A 1 + d +-+ dfc | 

k=l 

< £ \ U (k) - \^+d+-+d k - 1 | + u{ko + + X l+d+-+d^ : 
fc=l 

for any positive integer ko . But if fco > In In n/ In c?+c, where c — — In ln( 1/ A)/ In d 
then \i+d+-+d k o < and SQ alg0 u ^ ko + i) = 0{n- x In 2 n). 
For part (b) note that 

d TV (£(X t (j)),£x,d) < d TV (£(X t (j)),£(Y(j)))+d TV (£(Y(j)),£x.d) 
< d TV (£(X t ), £{Y)) + d TV (£(Y(l)), £ XA ). 

Thus, by part (a) and by Lemma 12.11 there exists a constant n = n(co) such 
that for each time t > v^ 1 cq Inn 

m&xd TV (£(X t (j)),£x,d) <Sn + ne^ t + 2e^ ln + 0(n- 1 \n 2 n lnlnn), 
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and the result follows with c\ = max{2, cq} r\ 



We now show that the O (n _1 In 2 n In Inn) upper bound on the total varia- 
tion distance between the equilibrium distribution of a given queue length and 
C\.d in Proposition 13.11 (a) is fairly close to optimal. The next lemma will 
complete the proof of Theorem 11.11 

Lemma 3.2 For an n-queue system in equilibrium, the expected proportion u(2) 
of queues of length at least 2 satisfies u(2) > X d+1 + ^(n -1 ). Hence 

d TV (£(YW(l)),£\,d) -^(n- 1 ). 

Proof. Let F t = £(l,Y t ) be the number of non-empty queues at time t, and 
write F for F\. We shall show that the variance of F is £l(n), and from that we 
shall complete the proof quickly. 

Recall that we model departures by a Poisson process at rate n (giving 
potential departure times) together with an independent selection process that 
picks a uniformly random queue at each event time of this process. If the queue 
selected is nonempty, then the customer currently in service departs; otherwise 
nothing happens. 

Let Z be the number of arrivals in [0, 1]. By the last part of Lemma \2. 31 we 
have the monotonicity result that for all non- negative integers x and z, 

Pr(F < x\Z = z) > Pr(F < x\Z = z + 1). (8) 

Let the integer x = x(n) be a conditional median of F given that Z — \_Xn\. 
(It is not hard to see that x = Xn + 0((nlnn)^) but we do not use this here.) 
Since Pr(F < x\Z = [Xn\) > \ we have by © that 

Pr(F <x) > Pr(F < x\Z < Xn)Pr{Z < Xn) 

> Pr(F < x\Z = [Xn\)Pr(Z < Xn) 

> J + 0(1). 

We shall find a constant 5 > such that Pr(F > x + 6n^) > jg + o(l), which 
will show that the variance of F is f2(n) as required. 

Let A be the event that Z > Xn+ (Xn) 5 . Then, by the central limit theorem, 
Pr(A) > i + o(l). We shall need to condition on A. 

If Z < Xn then all the customers arriving during [0, 1] will be called basic. 
Otherwise, we split the Z arriving customers at random into [Xn\ basic cus- 
tomers plus the Z — [AnJ extra customers. Let F be the corresponding number 
of non-empty queues at time 1 when just the basic customers are counted. (That 
is, we pretend that the extra customers never arrive.) Then 

Pr(F > x\A) = Pr(F > x\Z = [Xn\) > -. 

Call a queue shunned if it is empty at time 0, none of the basic customers 
has it on their list of d choices (so it stays empty throughout the interval [0, 1] 
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if we ignore any extra customers), and further there are no potential departures 
from it in this period. We shall see that with high probability there are linearly 
many such queues. Let S be the number of shunned queues. Let < 77 < 
(1 — A)e~( 1+dA '. We now prove that 

Pr(5 < V n) = e~ n ( ni \ (9) 

Choose < a < 1 - A and < (3 < ae~ xd such that < 77 < (3/e. Let B 
be the event that the number n — F of queues empty at time is at least 
an. Since E[Fo] = u(l)n = Xn (as we noted earlier), by Lemma [2.51 we have 

Pr(B) = e~°(™ 3 ). Let Q consist of the first \an\ A (n — F ) empty queues at 
time 0, and let R be the set of queues j 6 Q such that no basic customer has j 
in their list. Then 

E[\R\ I B] > \an](l - -) d l Xn i ~ ae~ Xd n. 
n 

By the independent bounded differences inequality (see for example [13!), Pr(|i?| < 
0n I B) = er n{n \ Let R' be the set of the first \f3n\ A \R\ queues in R. For 
each queue in R', independently there is no attempted service completion dur- 
ing [0,1] with probability e -1 . Then, since r\ < (3/e, conditional on \R\ > (3n 
with probability 1 — e _ °(™) at least rjn of the queues in R' have no attempted 
service completion during [0, 1], and so are shunned. Putting the above together 
yields ©, since 

Pr(S < nn) < Pr(S < r,n \ \R\ > (3n) + Pr{\R\ < 0n \ B) + Pr(S). 

Let H (for 'hit') be the number of shunned queues which are the first choice 
of some extra customer. Our next aim is to show (|10p . which says that when 
the event A occurs usually H is large. 

Let C be the set of extra customers whose first choice is a shunned queue. 
Let z = \^r\{\n)^\. Let C consist of the first \C\ A z customers in C. Let Z 
denote a binomial random variable with parameters [(An)^J and 77. Then 

Pr(|C'| < z I S > rjn, A) = Pr(|C| < z | S > T)n, A) < Pr(Z < z) = e - n{n ^ ) . 

Now if no shunned queue is first choice for more than two customers in C, 
then H > \C'\ — H', where H 1 is the number of shunned queues which are first 
choice for two customers in C . But, given A and S = s, ~E[H'} < (2) /s, and the 
probability that some shunned queue is first choice for more than two customers 
in C is at most (g)/s 2 . So, setting 5 — 577A2, it follows from the above, using 
Markov's inequality, that 

Pr(H >Sn? I S > nn, A) = 1 - 0(n~?) 

and so 

Pr(H >6n? | A) = 1 - 0(rT%). (10) 
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Next, we claim that F > F + H . To see this, start with the basic customers, 
and for each of the H 'hit' shunned queues throw in the first (extra) customer 
to hit it. With these customers we have exactly F + H non-empty queues at 
time 1. If we now throw in any remaining extra customers, then by Lemma l2.3l 
(c) we have F > F + H as claimed. Now 

Pr(F < x + 5n? \ A) < Pr(F < x \ A) + Pr{H < Sni \ A) < \- + o(l). 
Hence, 

Pr(F > x + 5n?) > Pr(F > x + 6n? \A)Pr(A) > + o(l), 

which shows that the variance of F is f2(n). Thus we have completed the first 
part of the proof. 

By expanding £(l,Y) d = [£(1) + (1(1, Y) - £(l))] d we find 

< E[£(l,Y) d ]-£(l) d = J2 (^)V[(£(l,Y)~£(l)) s }£(l) d - s . 

If d > 3, then by the second bound in Lemma 12.61 we can upper bound 

| J2 ( d ) EIW 1 ' y ) - = 0{n d - z ' 2 In 3 n). 

Also, E[(£(1,F) -^(l)) 2 ] = Var(F) = Q(n), and so it follows that E[^(l,Y~) d ] - 
£(l) d = fi^- 1 ), that is E[u(l,y) d ] - A d = flin- 1 ). But by © with k = 1 
(since u(l) = A, as we noted before), 

AE[u(l,y) d ] -u(2) = 0, 

and so 

d TV (£(Y(l)), C x , d ) > u(2) - \ d+1 = A(E[ U (1, Y) d ] -\ d ) = n (n- 1 ) , 

as required. I 

Proof of Corollary 11.21 Let k be a fixed positive integer. Let X denote the 
random variable Y^ n \l), and let the random variable Z have distribution C\,d- 
Let mi = [2 In Inn/ In dj. Then F,[Z k I z > mi ] = e^C 1 " 2 ™). We need a similar 
bound for E[X fe I x > TOl ]. 

By the bound ©, Pr[X > m x ] = e -°( lnrl lnln "). Also, by LemmaCOD (b), 
for any positive integer m 

m k lx> m ] < E[(Af(»)) fe I M( „ ) > m ] <nJ2 fX- 

j > rn 
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For to sufficiently large we have j k X>/ 2 < 1 for all j > to, and then the last 
bound is at most 

n J2 XJ/2 =nA m / 2 /(l-A^). 

j>m 

Now let to 2 = |~41nn/lni~|. Then for n sufficiently large E[X fc I x > m2 ] < 
e -inn+o(i)^ p u tt m g the above together we have 

E[X k I x > mi ] < m k 2 Pr[X > m x ] + E[X k I x > m2 ] < e -l»™+°«. 

Hence 

\E[X k ] -E[Z fe ]| < m k 1 d TV {X,Z) + -E[X k lx>m 1 ]+E[Z k I z > mi ] 

^ — In n+0(ln In n) 



3.2 Non-equilibrium case 

Here we aim to prove Theorem 1 1.31 where we still consider a single queue length 
but we no longer assume that the system is in equilibrium. We shall first prove a 
rather general result, namely Theorem l3.31 and then deduce Theorem 13.41 from 
which Theorem 11.31 will follow easily. We consider the behaviour of the system 
from time 0, starting from general exchangeable initial conditions. 

Theorem 13.31 below shows that uniformly over all t > the law of a typical 
queue length at time t is close to C Vt , where v t = [v t (k) : k = 0, 1, 2, . . .) is the 
unique solution to the system |T]) of differential equations subject to the natural 
initial conditions. The upper bound on the total variation distance involves 
three quantities <5„, 7„ and s n defined in terms of the initial distribution for 
Xq 71 ^ . Here S n concerns the total number of customers and the maximum queue 
length, 7„ concerns concentration of measure, and s n concerns how close the 
proportions of queues of length at least k are to the equilibrium proportions. 

Theorem 3.3 Let 9 > 1. There exists a constant ci > such that for any 
sufficiently large constant c\ and any constant cq there is a constant e > for 
which the following holds. 

Assume that the law of Xq 71 ^ is exchangeable (and thus the law of x\ is 
exchangeable for all t > 0). Define 

5 n = n-'miX^ ||i V<">|| 1>C oJ + Pr 0l*o n) lloo> 2elnn); 

and 

7 n = su P Pr(|/(^ n) ) - E[/(x( n) )]| > (cmlnn) 1 / 2 ) 
/ 

where the supremum is over all non-negative functions f € T\ bounded above 
by n. 
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Let v ( t n) = (vf'ik) : k = 0, 1,2, . . .) be the unique solution to the system {!]) 
subject to the initial conditions VQ l \k) = E[w(fc, Xq™^)] for k = 0, 1, . . .. Also 
let s„ > be given by s 2 n = Efc^i^ ( k ) ~ A^" 1 )/^" 1 )) 2 ^. Then 

sup d TV {C{x[ n \l)), Cm) < e- 1 (n~ s + n^s,,, + S n + n ln ) . 
t>o * 

It is known [20] that the vector satisfies ([2]) for each t > 0, and so C („) is 
well-defined. Note that the above result is uniform over all positive integers n, 

(n) 

all exchangeable initial distributions of Xq , and all times i > 0. 

We shall prove Theorem 13.31 shortly, but first let us give a corresponding 
result for a particular form of initial conditions, which we describe in three 
steps. For each n, we start with an initial vector x which is not 'too extreme' 
; then we allow small independent perturbations Zj, where we quantify 'small' 
by bounding the moment generating function; and finally we perform an inde- 
pendent uniform random permutation of the n co-ordinates, in order to ensure 
exchangeability. If say x = and the Zj are identically distributed (and non- 
negative) then we may avoid the last 'permuting' step in forming X^ n \ as that 

(n) 

last step is simply to ensure that the distribution of Xq is exchangeable. 

Theorem 3.4 For any constant cq > there is a constant e > such that the 
following holds. 

Let p > 0. Suppose the initial state Xq is obtained as follows. Take an in- 
teger n-vector x satisfying ||x||i< cqu and ||a;||oo< elnn. Let the 'perturbations' 
Z\,...,Z n be independent random variables each taking integer values, each with 
variance at most (3 and each satisfying E[e Zj / e ] < f3. Denote Z = (Z\. .... Z n ) 
where Zj — (x(j) + Zj) + . Finally let Xq be obtained from Z by performing an 
independent uniform random permutation of the n co-ordinates. 

Define v[ n ^ as in Theorem \3.3\ above. Then for each t > 0, the law of x[ n ^ 
is exchangeable and 

S npd TV (£(xt\l)),C v M) = 0(n- s ). 
t>o ' 

Note that if we set x to be the zero vector above then we obtain the simpler 
result we stated earlier as Theorem 1 1.31 It remains here to prove Theorems 13.31 
and EH 

Proof of Theorem 13.31 We aim to prove that there is a constant C2 > such 
that for any constant c\ large enough and any constant Co, there is a constant 
e > such that we have 

sup || u t - v t ||oo= 0(n~ £ + n~ c ' 2 s n + S n + nj n ), (11) 

t>0 

(n) 

uniformly over the possible distributions for X^ . Here u% refers to the vector 
ut(k),k = 0,1,..., where as before ut(k) = E[u(k,Xt)]. 
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To see that the theorem will follow from (fTTj) . consider a state x with || x ||oo< 
m. Couple (Xt) where Xq — x with (X t ) where Xq = in the way described in 
the previous section. By Lemma 12751 we always have || X t — X t ||oo< m. Hence 
always u(k + m,X t ) < u(k,X t ), and so E[u(k + m, X t )] < E[u(k,X t )) < u(k) 
(where the last inequality again uses Lemma |2~3")) . Thus, dropping the condition 
that Xq = x, for any non-negative integers m and k, we have E[u(k + m, X t )\ \ 
Xq ||oo< m] < u(k); and so 

u t (k + m) = E[u(k + m,X t )] < u(k) + Pr(||X ||oo> m). 

We shall choose a (small) constant e > later, and let m — |~2elnn~|. Note that 
u(k) = o(?i _1 ) if k = Q(lnn) by ([3]), and that Pr(||Xo||oo> m) < 6 n . But now 
we may complete the argument as in the proof of Proposition [5Tl] (a). 

It remains to prove First we deal with small t. We begin by showing 

that there is a constant c > such that for each positive integer k, each integer 
n > 2, each t > and each w > 0, 

PT(\£(k,X t )-nu t (k)\ >w)< ne'M^ + Pr(|E[^(fe, X t )\X ] - nu t {k)\ > to/2). 

(12) 

To prove this result, note that the left side above can be written as 
Pr(\£(k,X t )-nut(k)\ >w \ X a = x)Pr(X a = x). 

Let S = {x £ Z™ : \E[l(k, X t )\X = x] - nu t {k)\ < w/2}. Then by LemmaCD] 
there is a constant c such that for each x G S 

Pr(\£(k,X t )-nut(k)\ > w \ X = x) 
< Pr(\e(k,X t ) - E[l(k,X t )\X =x}\> w/2\ X = x) 

Also, the contribution from each x G Z" \ S is at most "Pr(Xo = x), and 
summing shows that the total contribution is at most 

Pr(X eZ»\S) = Pr(\E[e(k,X t )\X ] - nu t {k)\ > w/2). 

This completes the proof of (fT2")l . 

Now the function ~E[£(k, X t )\Xo — x] is a 1-Lipschitz function of x by 
Lemma 12.31 and is non- negative and bounded above by n, so 

Pr(\£{k,X t ) - nu t (k)\ >w)< ne~^ + supPr(|/(X ) - E[/(X )]| > w/2), 

f 

where the supremum is over all functions / G T\ such that < j(x) < n for 
each x G Z" . Hence, replacing w by nw, 

supPr(\u(k,X t ) — u t (k)\ > w) < ne 2t + ne 2 

ken 

+ su P Pr(|/(X ) - E[f(X )}\ > nw/2), 
f 
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since e <>+<= < e se + e k for a, 6, c > 0. Now let ci > 2/c be a sufficiently 

i 

large constant and set w = 2 (cin _1 (l + t) Inn) 2 . Then by the last inequality, 
we have, uniformly over t > 

supPr(|w(fc,X t ) — Ut(fe)| > w) 

fcGN 

< ne-( 4+o ( 1 » lnn + supPr(|/(X )-E[/(X )]| > (cmlnn)*) 

/ 

< o(n~ 2 ) + 7 „; 
that is, uniformly over t > 

supPr (|u(fc,X t ) -u t (fc)| > (^in-^l + fjlnnp") < o{ n - 2 ) + 7 „. (13) 

fcGN \ ' 

Hence, arguing as in the proof of Lemma 4.2 in [llj (Lemma 12.61 above), uni- 
formly over t > 

sup{|E[u(fc, X t ) d ] - u t (k) d \} = 0(n _1 (l + t) Inn + 7n ). 

fcGN 

We shall use this result only for < t < Inn. By we have, uniformly over 
< t < Inn and over k, 

= \(u t (k - l) d - u t (k) d ) - (u t (k) - u t (k + 1)) + 0{n~ l In 2 n + 7n ). 

at 

Now recall that u t is the unique solution to fl} subject to the initial conditions 
Vo{k) = uo(k) for each k. Also, 2Xd + 2 is a Lipschitz constant of equation (fl} 
under the infinity norm. More precisely, 2Xd + 2 is a Lipschitz constant of 
the operator A defined on the space of all vectors v = (v(k) : k G N) with 
components in [0, 1] by 

(Av)(k) = \{v(k - l) d - v{k) d ) ~ (v{k) - v(k + 1)). 

Equation (TTJ) may be expressed succinctly in terms of A as 

dt 

Thus by Gronwall's Lemma (see for instance pQ) there exists a constant C3 > 
such that uniformly over < t < Inn 

II ut - vt ||oo< ^(n- 1 In 2 n + 7n ) Inn e ( 2 * rf + 2 )*. 

Let ei = 2d+2 so < £1 < 2 \d+2 • Then there exists £2 > such that, uniformly 
over £ with < t < £1 Inn, we have 

II «* -«t ||oo= 0{n- £2 +n 7n ). (14) 
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For larger £ we introduce the equilibrium distribution into the argument. 
Note that sup fc \u t (k) — u(k)\ < n~ 1 d w (£(X t ), II). Consider Lemma [2T2l with 
c = max{co, frjjj let 77 > be as there, and suppose 2e < r\E\. By ([3]), there 
is a constant C4 > such that Pr(M > lnlnn/lnd + C4) = o(n~ 2 ). Hence by 
Lemma |2.2[ there is a £3 > such that, uniformly over £ > e\ Inn, 

|| Ut - u||oo= o(rT ei + 5 n ). 
Also, by inequality |7]) there is a constant C5 such that for each n 

Sup |u(fc) - \(d h -l)/(d-l) J < Csn -1 m 2 n _ 
k 

Let s„(£) > be given by s 2 n {t) = £ fc>1 K (n) (fc) " A^" 1 )/^" 1 )) 2 ^; thus 
Sn(0) = s n . We now use Theorem 2.12 in [4[, which says that for some constants 
7e > and Cg < 00, 

s n (t) 2 < e-^Cesl 
Hence we deduce that there exists a constant cq > such that for all £ > 

sup \v t (k) - \(d k -D/(d-i)\ < C6e -*/ C6Sn . 

Combining the last three inequalities, we see that for some £4 > 0, uniformly 
over £ > £1 Inn, we have 

II u t - v t |U= 0{n~^ + n~^/ c Ks n + 6 n ). 

This result together with fH]) completes the proof of (jTTJ) (with C2 = £i/ce), 
and thus of the whole result. I 

Proof of Theorem 13.41 Clearly Xq is exchangeable, and thus by symmetry 
so is X t for each £ > 0. Let us ignore the last step in constructing the initial 
state, which involves the random permutation. Note that this does not affect 
u t = (u t (k) : k = 0, 1, 2, . . .), and similarly v (k) = E[u(fc, X )} = ~E[u(k, Z)}. 

We shall choose a small constant e > later, and assume that E[e z ^ £ ] < (3. 
By Markov's inequality, for each n and each b > 0, 

Pr(maxZ, > b) < V e - b/£ E[e z ^ e ] < n/3 e - b / e . (15) 

3 . 

3 

Let us take b = b{n) = In 2 n, and let A = A{n) be the event that max^ Zj < b. 
Then by (JUJ we have Pr(A) = 0(e" ln2 "). Given a function / e T x such that 
< f{x) < n for all x 6 Z!f., let ^ = E[/(X )] and let /x = E[/(X )|A]. Then 
uniformly over such / 

l/i — Ml = IA — E[/(X )|A]|Pr(A) < nPr(A) = 0( e - ln2 "). 

Also, the variance of given 2j < b is at most var(Zj)/T?r(Zj < b), which is 
at most 2/3 for n sufficiently large that Py(Zj <b)>h. Thus given Zj < b, the 
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variance of Zj is also at most 2/3, and further Zj has range at most §6, assuming 
that 2e < Inn. Hence, by Lemma T2.81 for each sufficiently large integer n and 
each w > 0, 

Pr(|/(X ) - ji\ > w\A) < 2e~W^, 

and so the quantity nj n in Theorem 13.31 is 0(n _1 ) provided the constant c\ is 
large enough. 

Note that E[Zj] < e(3 for each j. We shall choose < e < 1 below. Let 
c = max{c + fi + 1, Then E[|| X ||i l||x- || 1>cn ] = o(l) since c > c + /?. 

Now assume that < e < 1 is such that the bound in Theorem 13.31 holds with 
this value of e and with cq = c. Then by (|15|) . with b ~ 2elnn, 

Pr(||X || oo > 2e\nn) < n(3e- 21nn = 0(n^). 

Thus the quantity 5 n in Theorem 13.31 is 0(n~ 1 ). 

It remains to upper bound the term s„. Note that 

Sn <Y, 0k (( v{ o n \k)) 2 + Y, ekX2(dk ~ 1)/(d ~ 1) - 
k>l k>l 

The second of these terms certainly takes a finite value independent of n, so 
it suffices to ensure that the first term is 0(n C2 / 2 ) where the constant C2 > 
is from Theorem 13.31 Now Vq (k) < u{\k/2\ 1 x) + maxj Pr(Zj > fc/2), and so 

v { o ] {k) <2u(Lfc/2j,.T) 2 + 2ma Xj Pr(^ > fc/2) 2 . Hence 

k>i k>i 

+ 2j]6l fc (maxPr(Z J > fc/2)) 2 . 
fc>i 3 

Using Markov's inequality again, Pr(Zj > fc/2) < /3e _fc / 2e , and so the second 
term is bounded by a constant uniformly in n, provided 9 < e 1 / 6 . This is 
certainly true if e > is small enough. As for the first term, if we let fco = 
2e Inn + 2, we have 

Y,0\u{\k/2lx)f < Q k H[k/2\,x)f 

k>l l<k<k„ 

< fc ko < n C2/2 

if e is sufficiently small. Combining the above estimates, we obtain the required 
bound ons„. I 

4 Asymptotic chaos 
4.1 Equilibrium case 

In this subsection we prove Theorem 11.41 concerning chaoticity of the queue- 
lengths process, where the system is stationary. This result quantifies the 



19 



chaoticity in terms of the total variation distance between the joint law of the 
queue lengths and the corresponding product laws. In the proof we first bound 
another natural measure of these distances, following the treatment in [TS] - 
see (HI]) and fl2D) below. 

Proof of Theorem 11.41 By Lemma 12.51 there exists a constant c > such 
that 

sup Pr (\f(Y) -E/(Y)| >en 1/2 lnn) = o(n" 2 ). 

Let F[ be the set of functions / € T\ with || / ||oo< n. By the last result, 
uniformly over positive integers a, 



sup E 



f[\f s (Y)-B[f s (Y)}\ 



< {en 1 ' 2 lnn) Q + o(an Q " 2 ). (16) 



Let Qi denote the set of measurable real- valued functions <f> on Z + with || (f> ||oo< 
1. For any measurable real- valued function 4> on Z + let <fi be the function on 
Z!f defined by setting <j)(y) = \ YTi=\ ^iVi) for V = {Vi> ■ ■ • j e z +- Observe 
that 

OC OC 

ftl/) = E <K fc )M fc > y) - u(k + 1, y)) = 0(0) + ]T(0(fc) - 0(* - y). 



k=0 



k=l 



Observe also that since the distribution of Y is exchangeable we have E[0(Y)] = 
E[0(y(l))]: let us call this mean value <j>. 

Let f(y) — (n/2)4>(y) = \ Y^i=i 4>{yi)- ^ i s eas y to see that if <j> G Q\ then 
/ G T'i- Hence by (|16p . uniformly over positive integers a, 



sup E 

...,<*aE6l 



n w) 



< (2cn- 1/2 lnn) a +o(a2 a n- 2 ) < (3cn~ 1/2 lnn) a 



(17) 



for ?i sufficiently large. But, by writing 4> S (Y) as (4> S (Y) — <j) s ) + <j> a , we see that 



E 



n 



can be expanded as 



AC{l,...,a},|A|>2 



Y[(MY)-J S ) 



.s£A 



n < 

s€{l,...,a}\A 



Hence by (|17[) , uniformly over all positive integers r < n 2 / In n 



sup |E 

...,<?Ve0i 



,s=l 
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* £ E 

AC{l,...,r},|A|>2 



n 



a=2 



< ( ' )(3cn^lnn) Q < ^( — rn-hnn) a 



a=2 



0(r 2 n _1 In 2 n). 



(18) 



Now 



E 



+ 0{r 2 n- 1 ) 



H$ S {Y) ="-E I I > '-,(T(.,n =E 

.s=l 

uniformly over r and all r-tuples <j)\, . . . ,<fi r 6 5i since when we expand the 
middle expression there are at most r 2 n r_1 terms for which the values of j are 
not all distinct. Hence from l|18[). uniformly over all positive integers r < n, 



sup |E[JJ^(y(«))] - H^l = 0(r 2 n- 1 In 2 71). 



(19) 



s=l 



(For r > ?t,2 /Inn the result is trivial.) Further, by Proposition 13. If a) . 

sup \4> — E^ A d {4>)\ = 0(n^ 1 In 2 n lnlnn), 

where E£ A d ((f)) denotes the expectation with respect to the limiting measure 
C\,d- Thus 



sup yi n E£ ^,d 



,)| = 0(m 1 In 2 n lnlnn) 



uniformly over all positive integers r (again noting that the result is trivial for 
large r). It follows that, uniformly over all positive integers r < n 



sup \E{]l<l) s (Y(s))}-]]Ez x J ( t> s )\ = 0(n-Hn 2 n(r 2 +rlnlnn)). (20) 
■ ■■,4>t&Qi 



s=l 



s=l 



Following Sznitman [18], the vector Y = (Y(l), . . . , Y(n)) is chaotic (in total 
variation) since the left hand side of (jT5J) tends to as n — > 00 for each fixed 
positive integer r. Thus (fT9|) quantihes the chaoticity of the equilibrium queue 
lengths Y in terms of this definition. Similarly, the inequality (|2"0|) quantifies Y 
being ^-chaotic. Let us note that, up to factors logarithmic in n, the bound 
in (|2"U|) is of the same order as the time-dependent bound of Theorem 4.1 in [5] 
obtained for a related class of models. 

The results (TT9)) and (|20[) yield bounds on the total variation distance be- 
tween the joint law of Y(l), . . . , Y(r) and the product law C(Y (l))® r , and be- 
tween the joint law of Y(l), . . . , Y(r) and the product law Cf r d respectively, as 
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follows. [In general, even for random variables Y(s) taking values in Z + and 
r = 2, it does not follow that if the left hand side of (fT9|) tends to as n — » oo 
then the total variation distance between the joint law of Y(l), . . . , Y(s) and 
the product law £(F(l))® r tends to 0.] Putting <f> s as the indicator of the set 
{k s }, we obtain, uniformly over positive integers r < n 



sup 

k±,....k r 



Pr(A r s=1 (Y( S ) = k a )) - l[Pr(Y(s) = k.) 



s=l 



0{r 2 n- l \^n) (21) 



and 



sup 

k \ ,. . .,k r 



Pr(AU(y(s)=fc))-nMW) 



But by ([3]), there exists a constant c > such that 



0{n In n (r + rlnlnn)). 

(22) 



Pr(maxF(j) > lnlnn/lnd + c) = 0(n ). 

3 

Hence in total variation distance, for any fixed e > 0, the joint law of Y(l), . . . , Y(r) 
differs from the product law £(Y(l))® r by at most 0(n _1 In 2 n ((1+e) In Inn/ lnd) r ) 
and by at most 0(n _1 ln 2 n ((1 + e) In Inn/ lnd) r+1 ) from the law Cf r d . I 



4.2 Non-equilibrium case 

We now no longer assume that the system is in equilibrium, and show that under 
quite general exchangeable initial conditions, chaotic behaviour occurs in the 
system, uniformly for all times. We need to prove Theorem 11.51 We first state 
two general results, Theorem l4.1l and l4.2[ and note that Theorem [T3] will follow 
easily from the latter. We then prove Theorem 14.11 and deduce Theorem 14.21 

Given an n-queue process (X^) and a positive integer r < n, let £(™' r ' 
denote the joint law of x\ n \\), . . . , x[ n \r), and let C^ 1 ^ denote the product 
law of r independent copies of (1). The following result shows that, as 
long as initially there are not too many customers in the system, the maximum 
queue is not too long and the system has sufficient concentration of measure, 
there will be chaotic behaviour uniformly for all times. 

Theorem 4.1 For each sufficiently large constant c\ and each constant Cq, 
there is a constant c such that the following holds. 

Let n be a positive integer. Assume that the law of X^ is exchangeable 
(which implies that the law of X^ is exchangeable for all t > 0). Let m > 0, 
let 

6 n , m = Pr(\\X^ || !> c n) +Pr(||X< n) || tx) > m), 

and let 

7n = supPrd/p^) - E[/(^ n) )]| > (cmlnn) 1 / 2 ), 
/ 
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where the supremum is over all non-negative functions f E T\ bounded above 
by n. Then for each positive integer r < n we have 



sup d TV (c[ n,r ^ , C[ n ' r ^ 



< c[(n _1 lnn)(m+lnn)+7„](m+21nlnn) r + (r+l)5„ 



We shall see later that it is straightforward to deduce Theorem 11.41 from The- 
orem 14.11 Theorem 14.21 below is a straightforward consequence of Theorem 14.11 
and shows that, in particular, there is chaotic behaviour uniformly for all times 
t > 0, when the initial state is obtained by perturbing a "nice" queue-lengths 
vector by a set of 'small' independent random variables. 

Theorem 4.2 Let cq > 0, sq > and a > be any constants. Then there is a 
constant c > such that the following holds. 

Suppose that the initial state Xq is obtained as follows. Take x G Z™ 
with || x ||i< cqti and let m —\\ x H^. Let the 'perturbations' Z\,...,Z n be 
independent random variables each taking integer values, each with variance 
at most a and each satisfying ~Ei\e s ° Zj ] < a. Let Z = (Zi, . . . , Z n ) where Zj — 
(x(j) + Zj) + . Finally let be obtained from Z by performing an independent 
uniform random permutation of the n co-ordinates. 

Then for each t > 0, X^ n ' is exchangeable, and for each positive integer 
r < n we have we have 

sup d TV (c[ n - r) ,C[ n - r) ) < cn- 1 (m + 2\nn) r + 2 . 
t>0 v ' 

Note that Theorem 11.51 will follow from this last result on taking x as the zero 
vector. It remains to prove Theorems 14 . 1 1 and [ 



Proof of Theorem 14.11 First we deal with small t. We start by arguing in a 
similar way to the proofs of Theorems 13.31 and 11.41 As in the inequality (JT3J) , 
there exists a constant c\ > such that uniformly over t > 0, over n, and over 
all non-negative functions / E !Fi bounded above by n, we have 

Pr(|n- 1 /(^t)-E[n- 1 /(X t )]| > (ci(l + t)^ 1 Inn) 1 / 2 ) < o( n - 2 ) + 7n . 

With notation as in the proof of Theorem 11.41 since the distribution of x[ n ^ is 
exchangeable, we have E[0(X t (rl) )] = E[0(X t ( " ) (l))]: let us call this mean value 
(4>)t. Uniformly over integers a and r with 2 < a < r, 



sup 



,(X t w )-(&) t | 



< 0((1 + t)nr 1 liin) +r 7 „, 



Using the above bound and following the steps in the proof of Theorem ll.4[ we 
find that uniformly over r 



sup 

...,0 r eSi 



E 



tufa 
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= O (r 2 [(l + t)^ 1 Inn + ry n ]) . 

Let M^") denote the maximum queue length in equilibrium. Then, arguing 
as in the proof of Theorem l3.3i given that || Xq 1 ^ ||oo< m, we have by Lemma [2~3l 
and © that 

Pr(||X 4 (n) Hoo^ m + k) < Pr(M (n) > k) = O^ 1 ) 

if k = [lnlnn/lnc?J + C2 for some suitable constant 02- Hence, uniformly over 
t > 0, over n, over positive integers 2 < a < r, over m > and over exchangeable 
distributions for -Xq , we have 

d TV (4 n ' r) ,jCi n ' r) ^j = 0([(l + <)n- 1 lnn + 7 „](m + 21nlnn) r ) + S n<m . (23) 

The above takes care of all t — 0(m + Inn). More precisely, we use the 
bound (|2"3"|) for < t < ?7~ 1 (m + 2 Inn), where n > is as in Lemma 12.11 
with c = Co . 

To handle larger t we introduce the equilibrium distribution. Let Y^ n ' de- 
note a queue-lengths vector in equilibrium. Denote by A / J < - n,r - 1 the joint law of 
y' n )(l), . . . ,F( n )(r); and denote by Ad^ n,r ' the product law of r independent 
copies of Y"(™)(1). Then for t > i7 -1 (m + 2 Inn) we have by Lemma [2.11 and 
Theorem H~4l that 

a TV {L, t ,L, t ) 

< d^{C n t '\MV) + d TV (M?' r ,M?> r ) + d TV (M?' r , IY) 

< d TV (M^ r , M n t ' r ) + (r + l)d TV (C(X t ),C(Y)) 

< C^n" 1 hi 2 n(2 In In n) r ) + (r+l)5 n , m . 

This completes the proof of Theorem 14.11 I 

Let us indicate briefly how to deduce Theorem 11.41 from Theorem 14.11 By 
Lemma 12.41 and equation ((3|, if we choose a constant cq > j^-r and m — 
In Inn/ In g? + c for a sufficiently large constant c then the term 5 n ^ m in The- 
orem [4J] is 0(n _1 ). Further, by Lemma [2.51 if the constant c\ is sufficiently 
large then the term j n is also 0(n _1 ), and Theorem 1 1 . 41 follows . 
Proof of Theorem 14.21 We fix s > and a > such that E[e s ° z j] < a for 
each j. Let (3 = ln(l + a), so that (3 > 0. Note that 

n 

\\X$ i >\\i = \\Z\\i<\\x\\i+Y l Zt 

and 

E[e s °^ + ] < 1 + E[e s °^] < (1 + a) = e p . 

Thus 
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< e- 2/3n E[e S0 ^=i z t] 

n 

- 2 P n Y[E[e s ° z t] < e-? n . 



e 

3 = 1 



Also, 



Pr ||X ]] oo >(m + — Inn) < VPr^ > — Inn) 
V s o / ^ s o 

n 

< e" 21n "^E[e s °^] = Oin- 1 ). 

3 = 1 

Further, arguing as in the proof of Theorem 13.41 by Lemma 12.81 the constant 
ci can be chosen large enough so that the term 7„ in Theorem 14. II is 0(n _1 ). 
Hence the result follows from Theorem 14 . 1 1 with this value of c\, with cq replaced 
by cq + |^ and with m replaced by m + Inn. We have 



sup 



d TV (^C t f l ' r \ £.[ n ' r ^ < cn 1 \nn(m + In n)(m + Inn + 21nlnn) r 
< cn _1 (m + 2 In n) r+2 . 
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